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ABSTRACT 

A prescriptive model of. problem-solving performance 
tis described. The aim of the model is to specify explicitly how 
Rroblems should be described initially in such a form as to 1 
facilitate their subsequent solution; According to the ; mo$el, the 
process of initial problem description can -be decomposed into two * 
successive stages. The first uses general"' domain L indepenclent 
knowledge tp generated "basic description" of a problem, the purpose 
of« which , is to identify, explicitly the information* specif iedt and 
wanted in the problem, ^ introduce useful symbols^ and to express 
the relevant information in various convenient symbolic : 
representations . 'This basic description is then used to generate a 
"theoretical description" of the problem, that is, f deliberate 
redescriptibn of ^hep problem in terms of special concepts provided by 
the domain-specific 'knowledge base A involving thef ^particular entities 
of interest in the problem, describing these entities ih terms of 
concepts specifically provided by the knowledge base, and exploiting 
,the known properties of thsse descriptive concepts. Focusing oh 
-mechanics, (physics) , the knowledge needed to generate theoretical 
problem descriptions is discussed, followed by- experimental methods 
for testing the prescriptive modf&l'anjJ selected results obtained from 
siich experiments. (kuthor/JN) °* 
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Problem solving is a centrally important activity in any science. In 
arder to teach such problem solving systematically, it is first rjecess^ry .tQ 
understand^ how good problem solving performance is achieved. 5uch an under-, 

■ * . m : ' 

standing, together with an understanding of the performance of aovfce stu- 
dents- before any instruction/ allows f on£ then to undertake systematic efforts 
to design explicit instructional methods for teaching problem solving. 

In trying to understand cognitive- mechanisms leading to good problem 
solving, i't*is instructive to study what expert problem solvers actually do 
(Larkin & Reif, 1979; Larkin, McDermott, Simon, & Simon, 198Q; Chi ^ Feltovich, 
and Glaser, 1981), but unwise to restrict one's focus in this wa^. 'In par- 
ticular, experts do not necessarily always perforin optimally. Furthermore, 
the performance to be achieved by students a$ a result ofMnstruction can 
not merely mimic expert performance./ IndeedL students must often use expli- 
cit procedures to achieve performance which experts accomplish almost auto- 
matically by recognizing patterns with which they have become familiar as a 
resuH of years of experience^ , » 



*This article is- based on work partially supported by grant #SED79-20592 from 
the National Science foundation. 



Accordingly, the aim, of oifr wprk, has been to study effective human per- 
formance, from a more general "pres-crip-fcive" point of view which transcends 
t^e^ description of natural istically occurring phenomena. In particular', our % 
•aim has -been to specify explicitly the kinds of underlying knowledge leading 
* to good human problem .solving performance in a realistic scientific domain, 
without necessarily trying to simulate what ectual experts do. Such a pre- 
criptive , point of view is clearly mor£ general than a descriptive one. For^ 

example, although a prescriptive theoretical mddel.of .good performance may 

* *" * ' / c - - 

be partly suggested .by naturalistic observations of expert behavior, it may-J 

• • * „> & < • ■ 

also be suggested' by purely t+veor^tical 'task-Anal jjstes.- Correspondingly;, the • 

erit6rion-of-vaVi^it*of ,a »p rescriptive models Osgood "performance is* solely. 

that* ft Mead to predictably, effective performance whe^ implemented .by a human 
ft - ^ ; , V - 4 * .V / • ; / • ■ . 

•subject; even if it'does not simulate cT&sely what actual -experts' do. 

An analogy might help to .clarify the distinction between a more general 

prescriptive point .of\view and a -descriptive, one. A hypothetical cognitive 

scientist, working- in the year 100 AD-to formulate a.mpdel of good porfor- 

mance lVari thmetical problem solving, might have suggested* the use of .the 

modern % pl ace-yalue. representations? numbers. Jhe. resulting model would haVe 

' led.to good arithmetical 'performance*. On the other hand, it would have been 

a very poor descriptive modeVof-the performance of experts,, all of whom used 

* ' > ' * . \ 

Roman nurr^ral s St th£t tinie. • - a ♦ - . - - . . \ 

A prescriptive approach is more general than a naturalistic one because 

it allows greater room for human invention anB 'experimental manipulation.^ It 

can also be very useful fo*r identifying essential knowledge required for good 

performance and can 'thereby help to explicate expert ^knowledge which is often 

largely tacit. From an applied point of view, ;a' prescriptive approach is 



also- centrally important for instruction and for attempts to imp-rove human 
, perfoYmance. " t 

. In trying* to specify explicitly the kinds of knowledge leading to good 
performance in ^scientific domain, we have focused our attention on good 
problem sol vi ng, performance in basic 'college-level physics, spectf ically in 
the field of mechanics. ' Such sdi eVitif ic problem solving is realistically 

complex., yet sufficiently simple to be amenable to systematic investigation. 

> • * * r * : ' . 

" Furthermore we have presupposed ,that the human subjects', who engage in such 

" ' * < ' ■ ^ ' ' * t " J - 

problem- solving tasks, possess well -developed fiuman c^pabil i tjes". such as a 

, knowledge of English, a knowledge of simple algebra, % arrdL a -knowledge qf 
\ ' " ' ' *' ■ ■ ' \ \ , % f \ 

.'basic physics principled. . On the'other-hand, we do not assume, that such 

• / , *' ' • ^ r A " - - ■ 

human -subjects possess more sophisticated or strategic forms of knowledge 

required for problem giving. Indeed', ouf'.main aim is< precisely to specify < 

explicitly such strategic procedures and forms of knowledge organization 

1'eading* to- good problem" sol ving performance. 

INITIAL PROBL EM DESCRIPTION ' . .' . . 

*0ur prescriptive model (Reif & Heller, 1981), which„aims to -specify 
these more' sophisticated fprms* of knowlege leading jto gdpd problem solving, 
involves knowledge of different levels of generality, i.e., domain-specific 
* knowledge (e.g., .specific knowledge about mechanics) embedded/in more general 
domain- independent knowledge. The' domain-independent knowledge includes 
general problem-solving procedures subdividing the probl^m-soh/ing process 
into successive stages. These stages include (a) the generation oj 7 an 

/ r * f *. 

initial problem description designed to facilitate subsequent construction*-' 
of the problem solution; (b) the actual construction of^Ehe. solution, in- 
cluding procedures for-making judicious decisions facilitating search; and (c) 
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the subsequent assessment and improvement of tHe solution. The preceding 

'general procedures are to fte used in' conjunction with a "knowledge base" con- 

taining specific knowledge about the particular domain of interest. This • 

knowledge base should have general characteristics: which facilitate the 

jmp-1 erne n tat ion of the general prohflem-sol ving pi*ocedures, e*g.,* it should 

contain certain kinds of knowledge -and be organized in certain ways., *Sudi • 

iitfportan't x:haracieri sties <^f the knowledge base must also be specified by a 
j ' , • • 

prescriptive model of good performance. , \ 

The description of .a* problem is of central importance s.ince the solution 

of a problem. can be implemented only if it'ha's been formulated in an appro- 

priate representation. Indeed, the initial description of a problem can 

Vucially detecmine how easily a. problem can subsequently be solved, or < 

whether it can be soTved at all. Actua] observations of experts provide, 

• • ■ . . . . \- 

however.* rather* little direct information about the description process. ' 

since experts tend to describe problems jrapidly and seemingly automatically 

on the' basis -of large amounts-of tacit' knowledge. ■ . 
/ . ■ *. ' - 

Our prescriptive model of good problem-solving performance aims to 

#» 

specify explicitly how- problems should be described initially iVsuch a form 
as to facilitate their subsequent. solution. According to this model, the 
process of Jni tial problem description can be- decomposed into two successive 
stages. The firsfof these uses general domain- independent knowledge'. to- 

« 

generates "basic 'description" of a* problem. The pu/rpose of such a-basic- 
description'Js merely to identify explicitly the information specified and , 
wanted in the. problem, to s introduce useful symbols,' and to express the rele- 
.varit information in various Convenient 'symbolic representations (e.g.,^pic- 
torial as well, as verbal forms). , * I 



> * I ■ 

Th.is basic description is then used to generate a "theoretical descr.ip- 

. • ' • ' / ' 

tion" of the problem, i .e. , ,a 'deliberate/redescription of the problem in •' 

terms of specral concepts prpvided'by the domain^-specif ic .knowledge base. 'In 
& / ^ . ^ ' ■ *^ . , 

particular, the generation of such- a thSln^tical problem description involves 
identifying the particular entitites of .interest in the- problem; desfcribing^ 

• • < i , .* _ V + • 

these entitites in terms, of concepts specifically provided by the knowledge 
base; ijnd exploiting the known properties of these descriptive concepts. 
Such a deliberate redescription of a problenTin 'terms of the concepts, p{:o- 
vided by the knowledge base greatly facilitates the subsequent search for a 

• - * * 

solution since all principles in the knowledge base are expressed in terms 

of.t'hese particular concepts and become then Readily accessible. 

The precedtng comments imply that <a, .well -structured knowledge fcrase about 

'« * * 

any domain' should have characteristics which facilitate /the useful descrip- 
tion of any situation within this domain. In particular, an effective know-' 
ledge base should specify the particular entities of interest in the speci- 
fic domain; the concepts most useful for describing these entities; and^the 
properties of the£e concepts. Furthermore, the knowledge base should contain 
explicit guidelines specifying procedures for using the preceding knowledge 
to'descrifte any 'si tuation within the specified, domain. 

' Because of 1 imitations' of,, time and space,, the .preseir^ paper focuses 
attention primarily- on explicit procedures for generating effective theoret- 
ical problem descriptions. Needless to s^fy, this ts only a small, but Upor- 
£ant, part of our more- encompassing model l^f good pfoblemi-solving .performance 

^Restricting our attention to the particular domain of mechanics, we shall 
• * * 

. ' .4" 
first specify, from 'a prescriptive pp.irit of view, tM knowledge needed to 

* ■ ** » 

generate good theoretical problem descriptions in this domain. Tben we shall 



.discuss experimental- methods* fair* testing such a theoretical model and some 

Qf the -^elultV obtained by' such experiments. „. /'< . . 

r * * • * j 

- v - ' - r r 

' THEORETICAL PROBLEM DESCRIPTION, IN MECHANICS f , 

<* „ * . ' ■ . • 

The preceding general remarks about! theoretical problem, description can 

now be exempl if ied in the particular science of mechanics by identifying the 

particular entities of interest irf this domain, the/special concepts used to 

describe these entities, and the particular properties of thfese concepts.' 

- • / *' . • • * 

'The knowledge ba'se of mechanics* specifies that the entities of interest 

'in this domain are particles Ehd systems consisting of several particles T 

(e.g., strings, rigid bodies,.-.). As indicated in' Figure 1 , -the knowledge 

base introduces two different classes of special concepts tp describe suth 

r . / ' • ■ . ■ . . 

particles, namely "intrinsic descriptors" and "interaction descriptors". The 
intrinsic descriptors describe individual particles. Some of these descrip- 
tors (such as "mass") merely characterize any particle; the others are 
^motion' descriptors" (such as position"* "velocity", "acceleration"-) which 
are used to describe the motion of any particle; By contrast, the inter- 
action descriptors dp riot describe individual particles, but the interaction 
between sgch particles. For example, a the "force" exerted on a particle by 
some other particle ijS one such interaction descriptor, "potential energy" is 
another one. # . • y 



Insert Figure 1 about here 



•The knowledge base for mechanics specifies important properties of the 
preceding descriptors. ' In particular, "interaction laws" specify how the 
interaction descriptors ar^ related to the intrinsic descriptors of the^ 
interacting particles (e.g., how the force on one particle by another is? 
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related to the characteristic's of the" particles and to their relative posi-^ 

tions). Such interaction laws are specified, for vanious kinds of interac- ' ; 

tions encountered ii* nature, but can be classified into the following two* 

types of interactions: Some: of these interactions are "long-range" because 

.they are appreciable even if the 'interacting particles are ^separated by an * > 

appreciable dtstance. , (The prime example is the gravitational interaction 

of a- particle with the eartR.) The other interactions are "short-r^nge'V 

because they are only appreciable when the interacting particles are so close f 

that they "touch" each, other. (Examples are the interaction^ a* particle ^' ny 

in contact with -a string or with the surface of a solid object.) 
♦ / * ^ 

Lastly, the knowledge base for mechanics specifies important "motion 
principles" which specify how tfie motion descriptors of ^particles change with 
time as a result of the interaction between particles (e.g., how the accel- 

0 .* 

eratibn of a particle depends on the force on this particle by other parti- 
cles). These motijzf^rincipfes provide- the science of mechanics with its ^ 
great predictive power. ' • *' m m 

The preceding factual knowledge in the knowledge base^for mechanics can 

. * <> * „ , - 

b> accompanied by explicit rule's specifying how this knowledge is to bemused 

for- generating an explicit theoretical description of any problerri in mechan-^ 
ics. The main steps of this description procedure aV& the following: 

(1) Identif> the; particles of .interest at each time of interest. 

(2) Describe the motion 'of each such particle by drawing a diagram ^ < 
indicating all 'available knowledge about the position^ velocity, and accel- 
eration of this particle. . ■ - 

(3) Descr|be the_ interaction of this particle by drawing a diagram indi- 
cating aTl' force's on- this particle. ,Do this as follows-: (a) Identify all 

• ;■ & ■ > w 

objects interacting with the given particle by long-range forces. (Ordinarily 



# 8 • . 

this is just the earth interacting with the v given particle by gravitational 
forces.)* Indicate' the corresponcfing forces and their properties,- as/ 
^ specified "ty the interaction laws for "Jong-range forces, -(b) Identify all 
objects which touch the given particle. For each such touching Qbj,ect indi- 
cate the corresponding^ shprt-^range forces and their properties, 'as specified 
by the interaction, laws for ^short-range forces. ' % ■ - / p • 

I * » • v " ■ 

(4) Check that , the description of motion* and of forces is qualitatively 

Consistent with known'motion 'principles (e.g., .that the' acceleration of the., 

* • * . \ 

particle has the seme direction as 'the total force on'H). 

The .preceding procedure, based on the knowledge base of jnechanics, £on- 

stitute-s a prescriptive model of how 'to. describe effectively any problem in 

* * * * • i • v 

mechaniGS. On.e would predict that- the implementation 'of this description 
procedure by 'a human subject should .lead-to thX^fol lowing 'important conse- 
quences: . - •. 

(1,) It "should lead to h very explicit initial description of any mechan- 

ics problem, in terms of the) special concepts of mechanics. Ln particular, 

^ * "* * * * - • - • '. * 

this description should be appreciably more explicit than that apparent from 
"observation^ /of experts or than that presented *in textbooks. 

(2) The description procedure should ^helpr students avoid many common , 

errors. For example, it should help avoid the common mistakes of omitting ~ 

. • • • • * 

'certain forces or* of enumerating non-existent forces.' 

" ' r - ' 

% - (3) The description procedure should sometimes, leact to easier reformu- 

1 at ion's of problems, (For example,' a question asking "when a string becomes 

slack ff is automatically transformed into a question asking, "when the force 

by the string becdmes zeVo", a qliestion which is much more easily interpreted 

4 

and answered. ) . : ' * 



'(4) The explicit problem description generated by. this procedure should 
appreciably facilitate the .subsequent solution of<mecbanics^roUTems. , t In- 
deed, the pn*i ti al problem description can be the major-difficulty in Gfertain 
problems and, 4 once implemented, canlnake thei.r subsequent S^ution fairly 
trivial. # ' 



• • -I 



4 • " EXPERIMENTAL METHODS FOR TESTIN G A PRESCRIPTIVE MODEL ' - 

* ■ 

In the preceding sections we have dutlined a prescriptive model whereby 
.a, human subjeot^hould /rel iably be able to generate useful jnitial problem" . 
descriptions.* As mentioned previously , the ultimate criterion of. validity 

• * * a V • 

of, such a model is*not whether it simulates closqTy what actual ^xp.erts do, 1 
but^whether it Ifeads to. predictably : good, performance. Accordingly, the ■ 
basic pa radigm^fo^, testing the validity t)f such a prescriptive modefl is the 
following: Induce a -human subject to act, in accordance* w,ith the prescriptive 

* model and observe whether th^resulting performance has the preditted and 
desired characteristics. " * 

, A particular way of implementing this general; paradigm is Tn' experiments 

•jn which* a human. ^i^ject is Irlduced to act under "external contra!"- This 

experimental procedure* may be clarified by a familiar analogy, the situation 

Where «a pilot lands his plane in bad^weather while following directions from 

an i r- traffic controller on the ground. Under these conditions, a human 

** ■ p- ~ ' * « * 

'information processor (the pilot) makes, extensive use of his. sophisticated 

knowledge, but 'relegates higher-TeveT control of this knowledge to external 

• * • • • 

directions. This situation ca v n be viewed as an experiment with the following 
interesting cha-wcterj sties : (-1) It allows a Separation of high-level .con- 
trol knowledge from lower-level implementation knowledge. 'For example, if 
the plane were to crash, the information retrievable frojn the taped 



conversations between pilot and ground control would allow one to distinguish 

whether the'crash occurred.'as a result of sound corrtroj directions-impropferly 

executed by the pilot, or 'whether it occurred as a result of faul control- 

"directions. By contrast, if a pilot crashed hi £p*lane while -flying entirely 

.under his own control, one could not distinguish whether 'the fault was in the 

pilot's higher-I.evel .control , kijowl^dfje or lower-level imp^mentation know* 

ledge. (2) A set flf.-control directions specifying how to land a plane can 

be viewed a-5 a cognitive theory specifying how a Kuoian subject, with sophis- 

ticated human capabilities', cap land a plane., fn other wocds, such control-. 

- ' „' ■ - / 

directions would constitute a good theory o/f plans* landing 'if , ajfr.only if, • 

the correct, ej£ecy£ion .of £hese directions leads to reliably effective landing 

of ' fftanes. (3) Such^ val idated'-theory of plane landing could ultimately be 

used as the basis of a theory of instruction "for landing plarfes* Such an 

instruct! ona'l theory would need to teach Ijtmian subjects 'to internal ize* and 



car$y dut^inciependently, ;the-contrordirections v which had previously. been 
external-. ■ - ^ * - • ,* " **- , x x • * 



. Let us now turn from que ^nalogNKto .externa.V-coritrol experiments *de-^J 
signefl to-test* othfer .prescriptive models of human performance, e.g. ,' rpodel s ' 
of effectite^problem'descriptiorv. , ;To.,darry out;Suc|j experiments, one needs 
first to design a program consisting of step-by-step directions, and asso- 

ciated knowledge, 4 whereby a human subject t can be guided to act in accordance 

- , ■ • . , • ' r - ^ ' . * J§ 

with a specified, model of performance. > Far* example, such a program might' 
gui^a human subject /to -execute .the "explicit description prdcedure dis-. 
cussed earlier. Such a program should be probl(em-independe^t,T.i..e. , equally 



applicable to any problem \si the specified domain. F^rthermpre, one miist> 

^ake sure that the directions in such a program are properly matched. to the < 

I * » ► 

characteristics and pre 7 exi sting knowledge of the human subjects for whom' thd. 



program is designed. In particular, the individual directions specified. by 

the program nnust be reliably interpretable and executable by the human sub- 

* v 
- ject. They must also be formulated at an appropriate level of detail** i.e., 

detailed enough to provicfe adequate guidance., but not so excessively detailed 

as to be burdensomej or distracting to the subject. ^ 

In the actual experimental procedure an individual human subject is 
then asted to carry out specified tasks (e'.g., tfte description and subsequent 
solution of various problems) by executing successively verjbally stated 
directions according' to a program specified by the mode!.. -While so doing, 
the subject is asked to talk out loud about his or her- thought processes and 
the whole session is tape-recorded. Detailed data can thus be gathered about 
the subject's written output and verbalized thought processes while respond- 
ing to the external control directions. >t I j 

Such detailed observations allow one to obtain the following kinds of 
information to test the proposed model 4 of performance: 

(1) Qne can ascertain whether the .proposed mqdel of good performance is, 
irr fact, sufficient to lead to good performance. This 9 cari be done by deter- 
mining whether subjects,* worKipg under ' exterpafl; control jn accordance with 
theoiodel , do indeed achieve good performance. (Note that such experiments* 
do not imply'that the proposed model is unique since otfrer models mjght ajso 

be suffitient, or 'even superior, in producing good performance.) 

* * 

1 (2) One can verify that the prerequisite basic knowledge, which the 
model presupposes of human subjects, is by itself not sufficient to produce 
good performance- This can be done by letting subjects, with such knowledge, 
work without external guidance of the model and observing that the resulting 
performance is poor. , 



/ : - . _i2 

(3) One can ascertain^whether selected features of the proposed jnodel 

r 

are, in fact, necessary to achieve, good performance. Thns can be done by 
comparative experiments- where human sybjects work under external control of 
a modified model which lacks selected features of the proposed model of good 
performance.; The predicted performance deficiencies should then occur. 

, (4) Finally, one can' test. whether the proposed model erf good performance, 
when implemented, leads to* specific predicted features^in the resulting per- 
formance. For example, one can ascertain whether, and how, the occurrence 
of specific errors is prevented when "human subjects act ft\ accordance with 
the model .' 

It should be emphasized tha.t the aim of such external -control experiments 
is to ascertain the merits of a proposec^model of good performance,, but' not 
to teach. Subjects may, of icourse, lear^n incidental Ty while working under 
conditions of external control. s However, such l|arni,ng need not occur 
because external control ^directions do not become internalized. A subject, 
performing very well while working under external control, might thus revert 
to poor performance when external control knowledge is subsequently removed. 

The following P3per, by Heller and Reif, discusses i-n much greater detail 
the implementation^ and results of such external -control experiments designed 
to>test a model for generating effective initial problem descriptions. 

*% • - • 
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